A Critical Note on Information Theory and Statistical Mechanics

This is an examination of the central argurnents of a number of papers, which attempt to derive the canonical distribution of energy (due to Gibbs) from a principle of maximization of Shannon's information. We stress that there are rnany other concepts of information, so that the idea of information maximization is as ambiguous as the other parts of the theory of inductive behavior. Besides, we stress that the 'information" approach does not allow one to dispense with a postulate equivalent to the second principle of phenomenological thermodynamics.

By: Benoit Mandelbrot

Published in: NC107 in 1962

LIMITED DISTRIBUTION NOTICE:

This Research Report is available. This report has been submitted for publication outside of IBM and will probably be copyrighted if accepted for publication. It has been issued as a Research Report for early dissemination of its contents. In view of the transfer of copyright to the outside publisher, its distribution outside of IBM prior to publication should be limited to peer communications and specific requests. After outside publication, requests should be filled only by reprints or legally obtained copies of the article (e.g., payment of royalties). I have read and understand this notice and am a member of the scientific community outside or inside of IBM seeking a single copy only.

nc107.PDF

Questions about this service can be mailed to reports@us.ibm.com .